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ABSTRACT 



The report determines the characteristics of the 
High School Characteristics Index (HSCI) both as a group and person 
measuring instrument. Four objectives are listed: (1) determine the 

item characteristics of the index as a group measurement instrument 
by using the ratio between means variance to within means variance as 
an index of item discrimination; (2) contrast the above analysis with 
the inappropriate procedure of item scale correlation and the 
correlation of the item means for the total qroup with the mean scale 
scores as indices of item discrimination; (3) estimate the 
reliability of the index both as a group and person measuring 
instrument; and (4) check the hypothesized factor structure using 
multiple group factor analysis. The index was administered to 3365 
junior and senior students in 16 Iowa high schools and tested as to 
item discrimination, reliability and factor analysis. Findings 
indicate that the HSCI should not be used as a measurement device to 
assess similarities or differences between groups of individuals. The 
index can be used as a measure of individual rather than group 
difference. [Not available in hard copy due to marginal legibility of 
original document.! (Author/MC) 
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INTRODUCTION 

The High School Characteristics Index is designed to assess 
student perceptions of their high school eiwiroranant* The in- 
strument consists of 300 true-false items* The i terns refer to 
teaching and classroom activities , to rule# and regulations, to 
school organisations , and to features of the buildings and 
grounds, etc* The high school environment is described in terms 
of 30 scale scores which are yielded by the 300 dichotomous 
items* Definitions of the scales appear in the Appendix* 




PURPOSE 



The HSCX has, in the past, been used .in several different 
r^sr-jsrcn situation* * For example , i fc has b*on used to wtwH .*• 



an a. mil victual *s peieeptlana o.£ the fo* *.:oa»p«u’ +. 1 ^ 



with his assessed needs* In several ins traces the HSCl has been 
used not as an Individual measuring instalment but to assess and 
compare the perceptions of groups oi: students from different 
classes or high schools* 

The purpose of the research which led to the presentation 
of this paper was to determine the characteristics of the HSCl 
both as a person and as a group measuring Instrument* It seemed 
unlikely that a measurement instrument such as this could yield 
meaningful data when applied to both situations , In order to 



% 
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a aaess differences in perception among individuals it is nec- 
essary to construct items which discriminate one individual * s 
perception from those of another.. Thus, if the Items comprising 
an individual measurement instrument are discriminating, consid- 
erable variance would be expected within the group of individuals 
being measured* If, on the other hand, the instrument is em- 
ployed to assess differences in perceptions of groups of people 
the items must discriminate between the perceptions of members 
of one group from those of another group of individuals. There- 
fore, one would expect low variance within group members hut a 
relatively larger variance between groups* The two uses made 
of the HSCI, individual and group measurement, are at cross-** 
purposes « The current study was undertaken to determine the 
most appropriate employment of the ESC 1* 

In brief# the objectives of this study were tot 
1* Determine the item characteristics of the HSCI as a 
group measurement instrument by using the ratio of between means 
variance to within means variance as an index of item 
discrimination * 

V 

2* Contrast the above analysis with the inappropriate 
procedure (for group instruments) of item-scale correlation and 
the correlation of the item means for the total group with the 
mean scale scores as indices of item discrimination. 

3* Estimate the reliability of the HSCI both as a group 
and as a person measuring instrument. The former assessment to 
be done via analysis of variance# the latter by the coefficient 
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alpha estimate. 

4. Check the hypothesised factor structure using multiple 
group factor analysis. Contrast the results with those obtained 
utilizing principal asses with Varimax rotation. 

pr ocmwius 

The High School Characteristics Index w©,s administered to 
3365 junior and senior students in 16 Iowa high school# * 

xten Piscriminftt iQn *• The items were first analysed to 
determine whc-sfcher or not they were useful in discriminating the 
responses of one high school group from those 1 of other groups*. 
Analysis of variance procedure was used as an index of item 
discrimination. The variance within each of the 16 groups vm 
computed , summed , and averaged to obtain the average within 
means variance. The total variance# i«e. the variance over all 
groups f was obtained, h ratio of average within group variance 
to total variance was yielded by dividing the former into the 
latter. This is a more conservative criterion of selection than 
a statistical significant F ratio of within to between variance* 
This latter ratio approaches a critical level when ‘there &r>; 
few as one hundred people in a sample 9 e.g. twenty groups o>, 
five persons each. Although it would# in mont Instances# h-:. 
unlikely that such small groups would exist In the measurement 
situation this example nevertheless does show that statistical 
significance is not a rigorous enough criteria for item selec- 
tion. For this reason a total variance/within variance ratio 
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of 1*2 wa & selected as the point below which items would be 
identified m "bad/ 1 i.e. non-discriminating items, above which 
the item was considered a ^good* item, i»e» an item which was 
useful in helping to discriminate among groups. While we would 
like to have the ratio as high as possible, a ratio of 1.2 was 
considered minimal since of the total variance 17 percent is 



between group variance and 83 percent within group variance. 

Out of 300 items on the HSCI there were 22 items which met this 
criteria of item discrimination * Fifty of the items yielded 
ratios equal to 1.1 or above. Ratios for the* remaining items 
were below 1.1. The evidence is clear that the HSCX cannot be 
employed to detect differences between groups of students in 
analysing their perceptions of various school environments. 

Items were also analyzed in regard to discriminating between 



the responses of individuals. The point-biserial correlations 
between items and the respective scales were computed. Prior to 
viewing these correlations the reliabilities of five HSCX scares 
were calculated in order to gain an idea of the size of correla- 
tions to expect. They tended to be low, consequently it was 
apparent the correlations would also tend to be somewhat lower 
than desirable, especially in view of the fact that each scale 



only consists of ten items. The average item-scale correlations 
and reliabilities of the first five scales are listed in Table 1. 

The range for all item-scale correlations was from a -.027 
to *551. A summary of all correlations is presented in Table 2. 
It should be noted that the correlations presented here have 
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Table 1. 


Average and range of 
correlations (tmcorr* 


item-* scale pain 
netted) 


t biserial 


SCALE 


JIVG. CORK, 


» ***** ****»«» lywnf ME****** «**». w,n >r.. »- V*iwt4« 

JXMJGE 




1 


.400 


.260-. 519 


.702 


2 


.341 


.261-. 423 


. 561 


3 


.293 


.092 *.372 


.611 


4 


.404 


.274 -.494 


.679 


5 


.411 


.318 -.491 


.749 






not been corrected for the. biasness which is present due to «he 
fact that the Item is part, of the respective scale score with 
which it is correlated • Thus they are somewhat, higher thar. what 
may be the actual situation. The corrected correlations which 
are highest represent the "good” i tems * Corrected correlations 
of above .20 are* generally sought. 



Table 2* Summary of item-scale correlations (uncorrected) 
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Another approach which was used as an index of item dis- 
crimination was that of correlating average item scores with 
average scale scores for the groups* This procedure was carried 
out on only two scales since it is not as appropriate for groups 
as is the analysis of variance method * 

Table 3. Summary of avg. item - avg. scale score correlations 



CORRELATION 


SCALE 1 


SCALE 2 


.90+ 
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B. Reliability - Scale reliabilities of the HSCI when 

mm ii mrnmm mtm im * mmmmmmmt mM* m 

used as a group measuring instrument were not calculated due to 
the fact there were so few items which were discriminating* No 
scale contained more than three of the original ten items which 
could be used to discriminate between groups* Several scales 
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contained no discriminating items* The magnitude of the average 
reliability for the scales car: be estimated by obtaining the 
reliability coefficient £ 0 / t.ho to-.. ai u?. . i ( 100 items’, arid es- 
timating the reliability for a test X/30 as long. Th.*U* conputa- 
tion results in an ejected average scale reliability of .308, 

It can be concluded that the reliability coefficients when the 
HSCI is used for group measurement/ are not sufficiently high, 
for most if not all scales, to warrant the 5 " use in basic 
research and/or applied situations. 

Reliabilities of the first five scales, when the HSCI was 
used as a person measuring instrument, were estimated using the 
coefficient a estimate. These reliabilities are presented in 
Table 1* These reliabilities are relatively low for the scales 
to be used for other than basic research. 

Employing analysis of variance procedures the reliability 
of the HSCI as a group measuring instrument was estimated. 

This reliability coefficient has no practical utility since the 
entire test has no score. Scale scores are interpreted but 
there is no overall test score. The reliability was computed 
to serve as an ©sample of the appropriateness of computing 
reliability using analysis of variance procedures. Scale score 
variance within each of the 16 groups was first computed. These 
variances were summed and averaged to obtain the within group 
variance over all scales. Each within group variance (mean 
square) was then xauXtiplied by the respective degree of freedom 
for that group to obtain sums of squares for each group* The 
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S.S. for each group were summed to obtain the within sums ct 
squares for all groups * Total sums of squares were obtained by 
getting the average scale variance for the entire sample ar.d 
then multiplying by the respective degrees of freedom- Th*s 
between group sums of squares were obtained by subtraction of 
within S.S, from total S»$» The between and within groups mean 
squares were obtained in the usual manner. The reliability was 
calculated by summing the within and between group variance} to* 
obtain an over all test reliability of .933. The valr.ee obtained 
are presented in the ANQV table in Table 4. 



Table 4. Reliability of the HSCX as a Group Measuring 
Instrument 



ANOV 



Source 


s.s. 


d.f . 


M.S, 


e*. M s. 


Total 


21,260.48 


3,364 






Within 


19,838.99 


3,349 


6. 32 


<%*■* *1*- 


Between 


1,421.49 


15 


94.77 


<rZ* + az,*-+ C 



w K OQ A d 

Reliability ** as* w *933 
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C. Factor Analy sis *** Another psychometric approach under-" 
taken was factor analysis of the scales comprising the HSC1 . 

The purpose of this analysis was to determine if the scales 
actually measure different aspects of student perception o:: do 
some of them measure essentially the same tiling. Thirty factors 
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were sought from the 30 scale scores using the principal axis 
method of analysis. The majority of scales loaded heavily on 
the first factor. This factor alone a ccountir! for 35.39 percent 
of the variance. This means that, the scales tend to ha measuring 
the same thing. The first four factors account for over sixty 
percent of the variance. It took twenty-two tractors to account 
for 26 percent of the remaining variance. Had the scales bean 
measuring separate aspects of the perceived environment one 
would expect to obtain thirty factors which would more equally 
account for 'the variance. Instead for measurement purposes the 
thirty scales yeild only four factors. 

The factors wer© not rotated as originally planned sino* 
the majority of items comprising the scales are poor. With poor 
items the scales are questionable. There wer a not enough good 
items to check hypotheses as to the construct# being measured. 

CONCLUSION 

The final conclusion to be drawn is tha: the HSCX should 
not be used as a measurement device to assess similarities cr 
differences between groups of individuals. Any study in which 
it is explicitly or implicitly indicated that groups of big! 
school students differ or do not differ in their responses cn 
the HSCX as a function of their group membership has likely 
generated erroneous conclusions* 

The scales of the HSCX can more appropriately foe used ns 
measures of individual than of group differences.. ftorne item . 3 
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need to foe replaced with "good” items. The reliability coeffi- 
cients of many of the scales are sufficiently large to warrant 
use in basic research but are of questionable magnitude for use 
in applied situations. 

Certain steps need to be taken to develop a more useful 
instrument for measurement of groups of high school students. 
For example multipoint items need to foe written to replace the 
dichotomous items* This would aid in improved item discrimina- 
tion and scale reliability* Items which do not discriminate or 
discriminate poorly need to be discarded. Keep in mind that a 
test of around 150 items is approximately the length desired. 

A test of this length can foe administered in one class period. 
The factor structure of the revised instrument needs to be 
determined with the goal of arriving at four or five scales. 
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Need-Pyess Scale Definitions* 

Abasement — ass Assurances self-depreciation versus 
sSf Confidence • 

Achievement; striving for success through personal 
effort. 

Adaptability — dfs Defensiveness; acceptance of 
criticism versus resistance to suggestion * 

Af filiation— re j Rejections friendliness versus 
unfriendliness . 

Aggression— b la Blame Avoidance ; hostility- versus 
its inhibition. * 

: flexibility versus routine. 

is junativity s planfulness 
felon.**” 

Counteraction — inf Inferiority Avoidance; restriving 
after failure versus withdrawal. 

Deference — rst Restiveness s respect for authority 

«i«- Ti »iWuiii».r*i-ir»n «* n «www wmtmm wm» 

versus rebelliousness . 

Dominance— to 1 Tolerance s ascendancy versus 

Ego Achievement : striving for power through; social 

action. 

Emotionality— pic Placidity s expressiveness versus 
restraint. 

Energy— pas Passivity : effort versus inertia. 

Exhibitionisnv-““inf Inferiority Avoidances attention- 

rr - r -^ n T - n rn l — |.. 1 f (nn , i— ,ri»MiTltir*..Miirri.wij».i tr — n n - n -i i in - » nr" ii ■«. > . wi n * nwm*+m* w4n i Wirnn . - | 

seeking versus shyness. 

Fan t as led Achievements daydreams of extraordinary 

T i raV »i -mi~nr.i.T i m i wr i w iii - w cr rwin - \— l td t*m* -rrr m *> nrnn — 1 ** 

public recognition. 

Harm Avoidance— rsk Risktaking s tearfulness versus 
thrill-seeking. 

Humanities , Social Sciences interests in the human- 
IHSFanl^^ . 

Impulsiveness— del Deliberation : impetuousness 

versus reflection. ***"’ 

Narcissism : vanity. 

Nurturance— re j Rejection: helping others versus 

indifference . 

Objectivity — pro Pro j ec tl vi fcy : detachment versus 

superstition (Al) or suspicion ;E1) . 



Change- - s am 
Conjunc tivity — da j D. 



Sameness 






versus disorganisa 



•^Stern* George C. Scoring instructions and college norms. 
Activities index and college characteristics index. Psycho- 
logical Research Oerter* Syracuse* New York. 1963. Pp» 2-3. 
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22 . 

23 . 

24 . 

25 . 

26 . 

27 . 

28 . 

29 . 

30 . 



ord Order — dso Disorder : compulsive organization of 

details versus carelessness, 
ply Play — wrk Work s pleasure-seeking versus purpose- 
nines s • 

pra Practicalness — ipr Impracticalness: interest in 

practical activities versus indifference, 
ref Reflectiveness : introspective con temp lafcion . 

sci ^le^eT ^'Tnter es t s in the Natural Sciences, 
sen Sensuality — pux Puritanisms interest in sensory 

******* W I W 'I W I « '**>**■ * 9 *mv m^ *mm u 0 ^ * *n 4m m **mr " * ** ** 

and esthetic experiences . 

sex Sexuality — pru Prudishness s heterosexual interests 
versus their Imiibition, 

sup Supplication— aut Autonomy : dependency versus 

s e if “reliance . 

und Understanding : intellectuality • 
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